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Introduction ' ^ . /; » -^^vv 

:. There has been a great . dea). 'of national research over the *pai»t decade 
about the effect of a wide' variety of.Bchool sit^ce ve^riablfes «^ their'* 
relationship to ia^bved pupil performance. Research results indi^e'-that 
•the number and quality . of t^e professional staff, particularly teacheWj 
key variables. Such evidence undoubtedly contributed to the eventiial Aelop-^ 
aent and enactment of two law by the California State legislature during \^ 
the last two years. California is the only state, thus far, to have "passed" 
effective legislation aaklng a coBaniffslon of lay«en and educators responsible 
,for regulating teacher education and licensing.^ . m addition, California has 
enacted a law requiring the evaluation of tieachers' perfonwuice.^ These 
two laws provide aa opportunity for the devel<ipnent of clearly define,! 
entry level standards for beginning teachers performance, and for the 

r 

continuing evaluation of certificated employees. 

The first of these two laws is known as the Teacher Preparation lind, 

Ucenaing Law of 1970. The law^ provides for the establishment of an 

autonomous coamiission of 15 members: Six persons on the condsUon must be 

c ■ ^ ■ ". , ■ \ 

certificated petsonnel ^rom the pubLlb schools; four must be from •accred\ ted 

public or private, colleges or universities in California; five, representing 

the law public, school board members or private citizens! Among the ' 
responsibilities delegated to the cj^ssion are: 



"S'eacher Preparation and U censing Lav of I970, Section 1311i^ 
(See Appendix A. ) ' ^ * • , 

^e Stun Act (Statutes of 1971) (See especially Article 5,5, 
Appendix B. ) ^ 
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1. ; the formulation of perfoniAnce- ctandards for general teaching 
ajad education flpecialities; ^ ^ 

2. the development of alternative ways to deiaonstrate qualifications 
for licensing which will aUow for individual dlffei-ences in candidates 
aM still protect again?(t incompetence; 

3- the development of objective, independently verifiable staridards 
of measureaient on evaluation of/ teacher competence. 

The second law, passed in 19;n^s commonly referred to as the Stull 
Act of 1971.. Article 5-5 of the Stull Act is entitled "Evaluation 
Assessment of Performance of Certificated Bnployees." The law prescribes 
a systm of objective evaluation guidelines which will be uniform for all 
school districts in California. The guidelines are to include the follow- 
ing elements 
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I. Standards or expected' student progress in each area of study and 
of techniques for the assc^i^sment of -that progress;. * 

^ 2. assessment of ^ertificatecDpersonnel conQ)etence 'as it relates 



to the established standairds; and 
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. 3« ^ procedures ^ techniques for/ascertainihg that certificated 
personnel are maintaining proper cont^rol and preserving a £\xitable learn- 
ing environment. \ 

Tfefe=i*o lavs/ require that atandar^s be established for both new and 
exper^nced teachers to provide for teacher accdnintability. To effectively 
estabiish^j^cour^ability, it is clear to the CoBmission for Teacher" Prep- 
'aration and Ei^calnsing that further; research is required to identify the 
necessary entry level skills of beginning teachers. Once the skills 



necessary for sucO-ssful teaching have been i'dentif led, they, can 'be 'used 
to Improve the quality, of teacher preparation prograBs^. lie 'requirement^ 
■ for specialist Inatructlon (advanced pi^atlpnj /credentials/ and an - ' 
array of subprof esslonal classroom positions can be determlhed baBed on • . 
. the skills necessary for teachers. . ' " \ ; 

Statqaent of the Prol5lem V V z \ 

The state currently licenses teachers based on completion of- a set 
Pf coUege course^^ and student teaching. There is groving interest, hovevet, 
in attaiqpting to reduce the inferential leap inherent in the assumption that 
coursework capped ^ff by a practi cum produces a person' ready to be licensed ' 
as a teacher. * . • , . 

It is, therefore, proposed that a baseline list of entry level skills '\ 
•be developed. Thld would enable currently existing teacher "preparation 
programs to become much more specific. For sample, if a teacher candidate^ 
/is able to diagnose a child's reading problem correctly; and this act Is 
, observed by a college supervisor of a school district, cooperating 

teacher, then one can be reasonably certain the candidate understands the . 
process of diagnosing reading problem^s. The normal procedure of " certifying 
"knowledge" about rea:ding dla^osis via a written te^t in the college, 
claasrom has thus been supplemented by an actual or slimulated perform^ce 
by the candidate, and one can safely say the inferential leap about the • 
candidate's ability to diagnose a reading problem has been substantiiaiy 
reduced. - ' ' ^ f 

.The research- problem is to identify those teacher comptencies which ' 
^ contribute most td elmentary pupils' cognitive and affective achievement.^ 
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If this can be done, the information ^11 be used to: . 

\ • * 

1..^ Develop techniques ?or the evaluation and assessment of the 
performance of certificated teaching personnel; 

2. Examine relationships between teacher behavior and pupil growth 
at grades two through six and to use thfs information as a basis for 
\ modifying teacher preparation requirements; ' ' • 

\ . • 3? Make the teacher perf omuihce expectations of community-school 
districts and teacher preparation institutions more congruent with each 
other and wi<th demonstrated relationships to pupil growth; 

> h. Identify those teaching ecmpetencies rqlated to teacher verbal 
ability which have resulted in teacher verbal ability emerging as, a con- 
sistent predictor of pupil achievement. 

5. Use the above to define baselifae entry level skills for: 
a* beginning teacher 'performance; 

b. specialist teewher performance (baseline plus); 

c. subprofessional (career ladder) performance (baseline minus); 

d. evaluation and assessment of the performance of experienced 
certificated employees throughout their careers. • 

Activities and Methodology 

A Preliminary Ev^uation Study Was organi'zed in three phases to 
accomplish the' following: . ' 

I: Identify the conmunlty-school district goals of those districts 
cooperating in the study; " , 

2. Identify the instructional objectives of those teacher preparation 
institutions which send te^ers into that canmunity- school district; 



3. collect descriptive data on candidates preparing to enter teaching 
for the first tiae, including verbal abilities and subject area knowledge 
tests. Observe each beginning teacher bn at least three occasions' using . 
a specially developed observation instrument. Reaffirm the reliability of 
the observation instrument by observing a second set of teacher*. 

h. Isolate those cospetepcies and sk^s demonstrated by teachers 
who are selected as Viperior teachers by their peers abd by' other school 
service personnel. This group will be given a verbal ability test. -In 
addition, they wiU be observed using the specially developed observation 
instrument. ' , 

5. .Examine any significant variance between high and low pupil 
achievement. Examine the demonstrated competencies of* the t<iachers w^o 
taught them. Pupils in both the new and the experienced teacher's 
classes. win be tested ieveral times each year on schievement in reading. 
Both cognitive and af fecial ve objectives will be developed froA community-' 
school district Educational goals. These identified institutional object" ' 
tives will be further tested and observed. > 

6. Establish' a list of entry level skills for beginning t?a^her ' • 
candidates. 

, 7. Compare and refine the entry list of skills based on the expect 
tations and goals of school district and teachef prep^ation Institutions^ 

" .8. Compare the entry IL^t of skills against observ^ competencies 
of -expert teachers selected by the peer ncjoination process. 

• 9. Evaluate the procedure by pretest and post-test achievement 
examinations of pupils of beglmilng and expert teachers. 
Pha^e-I involved the basic planning and ' developmental activities. 



.Phases II ajid;III involved additional testing .and interpretation of the 
independent variables isolated in Phase I, 
j rOutllne of the Tasks. Involving Phase I ' ^* " ' 

Phase I was designed to identify teacher variables through systematic 
investigation of the stated objectives of school district and teacher ^ 
preparation institutions and an in-depth analysis of the literature. 
Top priority variables wefe to be isolated. Then e^^sting measuijements 
were to be adopted new instruments Were to be developed, field treated, 
and revised. Student teachers Job cobperating teacher training institutions 
would then be^ sampled and their background knowledge and indiv^duayq&Z- 
teristics identified. Those student teachers in the sample who took Jobs 
in urban and rural schools in California would then be included tn> the study 
saarple during the following two years. , <.<,■■•' 
.DEVELOP IRE^IMINART RESEARCH DESIGN. ' V' 

;i. Secure outside expertise' to improve the Quality of the research 
design. ^ ■ "\ 

♦2. Determine protediire for" selecting teacher sample. 
II ffiEPARE PERT CHART OF RBiAINIHG PHASE I ACTIVITIES ' 

1. PERT Chart to indicate, actiAties^ within tasks- and their appro- 
priate interdependenc^es.' ^ ^ 

2. Use f>ERT Chart for d&Hy projec^^ aanagenent to assure that aU 
development, production, and delivc^ requirements are met. ' 

Tadk III REVIEW OP THE LTTOATWE 

1. Extract from litcratii^ those articles which relate directly to 
teacher competencies and pupil achievement. * v 



y * DEmtoP EDUCATIONAL GOAia WTTH CLIENT DISTRICT. . . 

C ' ' , ' ■ ' 

1. Jtdentlfy educational -goals ip-thtfse school dis1«-ict that have ' 

' • ' ' ♦ - . 

conmitted posltlona for new teachers for -1973 - 1974, . . ^ 

2. Use a ''forged-choice" process in order to rank' these goals. 

OBJECTIVES OF PARTICIPATING INSTITU^IOIB F(» - 
. CANDIDATES TO BBCBIVE A RBCOMMENDATiON FOR CERTIFICATION, 

. 1. Ask institutions- to develdp a list of objectives expected ofWr' 
cemdidates. - '. ^ _ ^ 

.^^^ oS^vST^^^ '^^" COMMin«/Y DISroiCT C^AI^ AND INSTITUTIONAL 

1. categorize institutional objectives- under canmunity- school district 
goals to determined the degree of congniency. ' . 

2. When institutional objectives do not include the higher ranking 
coonminity-school .district goals, the institutions vouW be expected to develop 



them 



3. ^^asurable competencies which are consistent with the goals and 
objectives would be identified. ' ^ 

4. competencies abstracted fron related 'research (e.g. teacher verbal 
ability) would be required on the list of priorities. . f - 

5. A select group of teacher trainers and ^school district personnel 
vould review refine, and establish a set of priorities for thr list of^ • 
identified ccanpetencies* 

6. Wi-ltten tests and observational instruments tc measure the 
competencies wo«ld be adopted, adapted, or develpj/,. as A-scribec. in 
Task VII. ' 

Task VII THE SED^ION OF HEASURHsffilW ' ' - 

1.. A test win be developed to measure' those competencies"^ rated im- , 
portant by community-school districts. 



2. A test will be developed to measure those objectives and skills 



coqaidered Important to teactiAig candidates by teacher preparation fnstutions: 

3. , A Verbal ability teit will be developed to be administered to 

. ■ : X I ■ ' U . • ■ 

beginning and experienced teeuihers. ' * 

k. A multiple , subject test, or single subject test^of teacher knowledge 
in their area of specialization will be' developed to^ be adalriistered to 
•beginnlng''^each9rs. * ■ 



5. . A test of knowledge^f^the proGess|s used to teach reading at the 
eleaentary level will be developed to be administered to beginning teachers. 

6. An instnanent to gatheV pertinent demographic data, such as 
experience, education, sex, race, age, etc,,,. will be developfe<i to be ad- 
ministrated to begiiiniixg and experienced teachers. 

7. . ^ Instruitients to measure cOg^tive and affective ofjectiv.es will be * 
. developed^^o be adAin;j^tered to pupil^B./- ' ^ . \ 

' . A cla^room observation instrument vlll be developed to record 
te&her behavior within categories. Inbluded within this instrument will be ^ 
j)ehaYiors rel^^cfii to teacher , verbaLL ability. i ^ ' 

NOTE: The development . of measures 9f teacher behavl-or fiuigL ^ 
^its application to techniques in, the classrooia is of particular 
^ importance. ^ Thus, the diagnosis and seleation of aLlterliate 

paths for pupil learning aiad th0 evaluation of pupil per- 
formance goals warrants additional enph^jisis. Although paper 
and pencil *;est caji be utilized, -a special effort^to develop 
^ skills will be included. In-depth case studies^^ the arialysiV 
^ of individual videot^apes micro-teaching wili be utilized. 
Extensive classroom ob»e?vi6tion would be required to assess 
teachet" behavior. * 0 
' '\» - ■ ' r • » • » 

TaCBk Vlli mE TEST SPECIALLY DBSIONia) KEASlRQfflJfP INSIRUMEIOB.' 

\ . ^ 

1. Measurement instruments would be pre-tested by discussion with 

. ' ^ **,».. 

potential respondents and pilot testing under quasi-experimental conditions, 
•^appropriate. 

^ ■ ' . ■ 1 i ■ ■ 



2. I^struMents wlUL be prb-tested and modifl'ed as necessary to' assure 
an accisptable final product. ^^^^ ' * 

3. ,The pre-^test; for claasro^^&servation instruments may invol^ved ' 
classroom'or yideo;^taped siKulation situations. * 
Ta4k IX ' DEVELOP DATA iUALISTS PIJ^ > ' 

' ■ ' ' . \ ■ ' W ^ C * ^' - ' 

1. Consideaition will be given to Various statistical techniques for : 
data analysis. 

• 2. ^ Regressi^^^diaysiB aay t^sT employed to determine theTdegree to nhich 
student perfornance can b^ predict edfroa teacher training, characteristics 
or beharior. Analysis of vari^ce (or multi'-variant analysis of variance)* 
»ay be used^p determine differences between beginning aM expbriencecT ' ' 
teachers. ' * /' 

3* Planned data euaalys'ltf will determine: ^ 

Character! Btic 8 of both beginning And /experienced teachers ,'. 
^ which gignlficantly affect student cfchleV^Ment. 

b. those teachers whose pupils, as aH^l:2UP^ achieve the most, - 

c. behavior^ of teachers, whose pupi^i^ show the greatest gains, ' 




d. relationships between the} Identified expectations regarding 
^ effective te^^cher behavior anirthe measured success Of 

beginning teachers In the classrocm, * 

e. relationships between the Idijntlfled expectations regarding 
effective teacher behavior and the knowledge learned and 

^ utilized in the classroom by beginning teachers, ^ 

f. uthe 'degree to ^ch teachers Baintaln into the second year of 

teaching behaviors which have been determined to be related to 
sliudent achievement. 
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■ Task X DATA SYOTBM DESIGN AliD DEVKLOPMBHT 

1. A computer data syBtm will be developed to facilitate data storage, 
• editing, retriev«LL, and tuaalysia. ' ^ • . • 

2. This task will entail planning, develpnent, and syBtems design for 
all coaputer-related aspects of T^isk XII, and preliminary systems design and 
development activities that would be continued in Phase III. ' . 

• • • • ■ ' . • ' Y 

. ■ 3» Procedure for tallying,, coding, editing data will be developed in 
conjunction with a master data file format. Computer programs will -also be 
selected oi^ written aind debugged, as necessary. 

4. The following minimum objectives will be met for Task X. 

a. Ease of maintenance and updating of the data base, 

b. ability to restructure the data base, if necessary, 

c. flexibility with respect to changes in editing requirements, 

^' responsiveness to queries with a minimum of ad hoc programming, 
e. Provision df flexible procedure^ and software for plaimed and 
unexpected analyses. 

5. Although the computer software system cannot be specified until 
Task X is- underway, it is anticipated that one system of comiwitible software 
would be developed that would encompass data conversions, data editing, error 
resolution, data retrieval, and analysis. Software necessary to convert , and 
date would probably have to be written, but available programs can be, used or 
adapted for file building, updating, data retrieval, and analysis. 

Task* XI SELECT SAMPLE OF TKACHTOS 

1. Select a sufficient number of teacher candidates to provide an adequate 
number of teachers in each ctell in the sampling- ^ilgn after exclusion of those 
teachers not obtaining Jobs -in the targeted California School System. 

2. Assess for each teacher and schsbol those critical variables not o 

i : 
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included in the sajipling design, such as verbal ability and socio-econofflic 
status. These variables will be included in the data for Phase II and 
Phase III data analysis. 

Task XII COLLECT AMD HIOCKSS BASELIIIE DATA 

1. Collect any baseline data that would have to obtained prior to 'the 
•start of Riase II. . If the student teacher 'sampling' involvee- stratification 
on certain teacher characteristics, this infonnation will be collected fro« 
records and/or test data during Task II. 

2. Additional information on teacher characteristics and background 
win be collected after the sample is drawn to provide base line data for • 
measuiiing change and for drawing conparkble samples of experienced teachers 
for Task XIV. ^ T ' 

3. Data would pfermit comparison of beginning teachers with student 
teachers not placed in the target population of California schools., Differences 
between these saaiples may help to identify crit^la which school districts 
apply, explicitly or implicitly, in selecting future beginning teachers. 

Task XIII COCRDIMTE WITH SCHOOLS AMD SELECT SAMPLE OF KXPERIEHCED TEACHERS. 

1. Contact superintendent of employing , school districts during the 
last six months of Phase I. 

2. Include the following Incentives for cooperation: 

a. Developed objectives and student achievement indicators to 
assist participating schools in future evaluation of all 
certified personnel. 

b. Participation by teachers and administrators in the project 
would constitute' a f onn of in-service training In identifying 
critical teacher coitpetencies. - » 



Participation Would be acknowledge in published reports. 
Task XIV INTffilM OOTSIDE EVALOATION/AUDIT 

^ JfT ^Outside expert consultants would provide technicea advice at key- • 
points in the project. 

2. Evaluative procediureQ,^ either an .audit or -general procedural 
evaluation of all phases of the project, would be conducted by an outside 
consultant or subcontractor Independent of th# Ccnil'sslon and other sub- 
contractors. The purpose of the audit would be to verify that the con- 
tractor and subcontractor had fulfilled their commitment. 
^a^^ XV H^BPARE IKPHRIM REPORT ON PHASE I ACTIVITIES 

1. An Interim Report would suasnarize Phase I activities. 

2. This report would include sufficient information for an eval- 
uation of the research design, and the tentative data analysis plans, and 
an assessment of the measureaent instruments. 

3. The Report would present evidence regarding the cooperation obtained 
fran school districts and teacher groups and indicate the adequacy of the ; 
selected teacher sample interims of the research design. 

Planning and Developaent Activities for Phase II and III 
In Phases II and III teacher and atudent variables will be aoseesed in 
cooperating school districts. Beginning teachers wlU be compared with teachers 
having several years of successful experience, and with teachers identified 
througWa forced choice nomination of both teacher peers and other school 
service personnel. T^ie experienced teachers wlU be selected at the same 
school, or .district, in which the beginning teachers Identified in Phase II 
will be assessed over a two-year period. For beginning teachers in Phase III, 
the assessment would encompass one year. Pupil gains would be related to 



competencies of beginning teachers and this aa|a will be compared to the 
data generalized from the experienced teacher group. 
Population of Phase II 

Apelrojcimately kOO teachers would be included in the Phase II assessment, 
half beginning ,teachers, and half experienced teachers. With a teacher-pupil 
ratio of approxJjaately 30 to 1, it is eatimated that 12,000 pupils will, 
participate in Phase II. it is hoped that classes would provide representation 
frcrn such varied teaching settings as: ^^^^ ^ suburban; rural including 
migrant; monolingual bilingual; disadvantage^; representative racial ''grbups; 
and varying economic backgrounds. 
Time Periods for Phase II and III 

Phase II covers the 1973 - 197^ period of the project, the fitel! of 
the testing period. Phase III covers the 197k - 1975 period, the second^'^ar 
of the testing period. The individual Tasks for Phase II and Phase III can-, 
not be determined in detail until planning in Phase I is underway. The 'follow- 
ing timetable of Tasks is anticipated for Phase ir and III. 

Timetable for Phase II and Phase III , 

Tae^s I Prepare PffiT Chart of the activities for each Phase, 
(This task is similar to and would extend the PERT 
Chart prepared in Phage I, Task II) 



Task II Continue data system design and development. (Data 
system design and development initiated in Task X of 
Phase I would be continued and expanded as necessary 
for Phase II and Phase III.) 

Task III Orient schoo J v imlniatratQrs^^^incipalSj and professional teacher 
groups. \ 




Task IV Preparfe for fall I973 data 
Task V Collect and edit fall I973 dlita> 
Task VI Prepare for spring 1974 data collection. 
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^s^t VII Co-ilect and edit spring 1971; daca. , n 

Tadk VTII Analyze 1973 - 1974 data. 

J^. Revlev 1973 - 197^ data and prepare Interim Report. 
Prepare Interim Bvklulitl oh/Audit. 
Taa^^ XI Modify assessment yad analyals plana. * ''^^^ 
"^"^ XII Modify meaaiu^'emenf Inatrfcmeifts or techniques als i:|p^^.rW." 

Task XIII - .Tafe jtyTl' Task XIIII - XVII will be similar to '^fi^' 'v%ti 
above, but for the 1974 - I975 school year. 'i V,, .. — '—^ 

Task XVIII - final Rep6rt. ^ ^ ' ' 

Tasks xn - Final evaluation/audit. 
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. ■ SECTION II 

. Introduction ' - ' 

in October 1972 the Ccmnlsslon for Teacher Preparation and Licensing 
. was aaked by the Office of Economic Opportunity to hold a conference Involving 
educational researchers, teach4r educatorp, educational administrators,, and ' 
■others who might be affect bj/ the study, to review the entire existing .design 
of the study prio^ to final ^Iwlsslon of a document to OEO for further 
■funding. ^ ^ 

^ ThlB conference was t^eld on February 20, 21 and 22, 1973 in S^^cramento, 
^''^^^'^'^'^'^ Educational consultants to the conference included: V ' 
Dr. Walter Borg, Utah State' University ' ; 

Dr. Fred Braun, University of Hawaii ''^ 
Dr. Robert Bush, Stanford Research and ^Development Center ' 
Dr. l^e CJjfonbtich, Stanford; University ». / ■ 

Dr. Wlliiam Fisher, Superintendent of Schools, Orlnda 
Dr. Robert ftigrle. Center -Behavioral Sciences, Stanford 
Dr. John Ooodlad, Dean, Graduate School of Education, U.C.L. A. 
. Dr. Herold C Hunt, Harvard University 

Dr. Charles Johns6n, University of California, Berkeley 
Dr. Hall Marderosian, University of Massachusetts 
Dr. Barak Roserishine, University of Illinois 

Dr. Nick Si Ivaroli, Arizona State University. ^ 
Dr. Henry Leviq/ Stanford University . _ 

Dr. Marcus Foster, Superintendent, Oakland City .Unified Schools 
For a complete list of conferencfs attendees, see Appendljc C. 
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COHFhTenCE RE^POieiBILITY * . *• 

^ • •■ ■ 

The CoBnnlsslon assigned the in-laary responsibility for the conference 
to the Executive Secretary of the. Conmisslon, Dr. George Gustafson. He was 
emplowered to secure advisory and consulting service to plan the conference. ' 
Further, with the advice and consent of the Conmission he was empowered to' 
secure the best avallab^ consultants to ensure the achievement of the ' 
conference ■''objectives. '' ' 

CONFER EJtCE- OVIFVTEW ^. < 

^ Coiiference consultants were ask^d/to respond to a set of questions 
concerning the proposed study design. "^A detailed analysis of the responses 
^from the GoVsultants a need to synthesize the responses in a manner con- ^ 
gruent with the Design Conference work schedule. .Two key. areas of ioncern 
emerged from th«!', analysis, namely Pupil Pe^^formance and Tekcj)^ Performance. 

Further/ delineation of key elements of concern to consultants 
indicated that socio-econanlc factor^ resources (both human and material), : 
and^the instructional Q^g^^^^^^jfe^ more directly to Pupil Per/^orman^ 
while overall school envlro£m|^^^school district expectations, teacher 
verbal ability, conmuMcation skills,, professional; training, academic back^ 
grourm^and socio-economic factors related , more directly to teacher performance. 

An overview of the critical issues was^prepared prior to the conference, 
to avoid the possibility of prejudicing- the conference 'outcomes with a detail- 
ing of the variables in. the above listed elements of concern. 

This. approach minimized contamination of the elements and issues to be 
considered at the conference and maximized the potential for comprehensive, 
consideration of all aspects of 'teacher performance. Further, this approach 
permitted the consultants to explore many avenues worthy of consideration re- 
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lAtSd to teacher preparation and licenfling. Finally, this procedure optimized 
the provision to the ConaaiBsion of a broad spectrum 6f relevant Buggestions 
from the consultants to improve both the project design and the re8ulta.ng 
study. , - . ■ 

However, the, consultants did consider certain issues whi<:h were of 
critical importance to the Commission. These issues were: 

Pupil Performance; . • 

1. . What socio-economic data should be gathei^ed on Piipils? why? 

2. What generic performance measures should be utilized; normative 
criterion reference or both? - ' 

' 3. Should the study be limited to one or mwe types of instructional 

organization, e.g. .self-contained classro;* teiun teaching situations, 
xarge groups, small 'groups, tutorial or others? 

TeieiGher Performance: ' 

. 1. What verbal and cOBBiunicative skills are important in a -learning 
situation which inapiref^, fosters and achieves maximum pupil 
achievement? - . . 

2. What, if any, specific academic background, ".including subjects - 
studied and/pr grades attained, impacts negatively or positively 
on demonstrated teacher competence? 

3. What socio-economic factors, if any, impact negatively or positively 
on demonstrated teewher competency? 

4. What specific expectations do Teacher Preparation Institutions have i 
relation to teaching competency? 

^j. What specific exit skillii should Teacher Preparation Institutions' re- 
quire or graduates? f> - ' ' 

6. How can significant behavioral characteristics of teachers whose 
students achieve a high degree performance be documented? 

7. H^/ can criteria regarding behavioral characteri sties be estabUshed? 

8. What, effect does the organizational strufcture of a school have on 
teacher performance? 

9. What impact do sijoary, fring benefits, cost per pupil and other 
systemic variables have on teacher performance? 

10, What impact do stated school district expectations have on teacher 
performance? 
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What impfl^ct does the degree 
expectations emd the actual 
te€W!her performance? 



of congruence between the stated, 
operational environment have on 



J5BCTI0N III . 

CONFHIEUCE FIMDIIGS ^ ' ' 

The conference piartlclpants were divided Into four working groups or 
conmilttee. Bach conmlttee met Individually to consider, the Issues of major 
concern to the Coailsslon. Each connlttefe then met with each of the other 
coomlttees to summarize and further review their discussions. A summary 
report, prepared by each cc«lttee, ' ftidlcates the thinking of the ccmmdttee 
regarding the proposed design and the major Issues of the confidence. 

-Thf four coimnittees were designated; teacher perfonaance conalttee, 
pupil perforalalice ccmaittee, school district expectations of pupil per - 
fonnande assessment committee, and teacher preparation Institutions' ex- 
pectations. 

■ yjPal Confe rence Report froft TEACHTO PERFORMAICE CCMMITTEE 

The probability of co»Q)lete success In Identifying, measuring, and- 
evaluating teacher behaviors was questioned by several mmbers of the teacher 
performance phase committee at the outset of the meeting. Nevertheless, the 
cqimilttee concluded that the present syst« of teacher certification Is In- 
effective ^ counterproductive to the educational needs of California and 
the nation and that a study^esdlng to a more equitable system Is both ,- 
Justified and needed. For example, the process of codification of effective 
teacher behaviors would have national Implications, since It would advance 
the knowledge of teacher perforwuice. It may also provide a potential to ' 
Increase student achievement. Even minimal success would Justify the time, 
talent, and revenue to. research an alf^rnatlve approach to the present system. 
The camlttee also felt that the study Is Justified for It would provide the 
vehicle to correlate and synthesize other bodies, of Information related to 
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teacher behavior and student achievement vh^ch heretofore have had. a 
limited iinpact o/ ^ie training and licensinTof teachers^. In addition, , 
the study is needed to ccnply with the<3nandate of the Ryan Act. "\ 

The teacher perforaaiice pha,e coamittee discussed other areas of '^ft 
study. The general are^ of discussion are ojitlined b*lov.^ i 

bS" I'JSenJ: iT^^'- Sijr°»«^ poor, i.e./ should 

re^L i? thl ' "T^r «?P«^>«d *° achieve skills in 
JofiJf ^^'^^^ *||pioW level iiasn't prepared them. 

Should the tsducationSl goals of the blacks be adjusted to the 
specific talents individuals .demonstrate? As ^e m«be^ p^t 
it, should we expect high Jumpers out of runners?" 

3. There was discussion pursuent to a stlggStion that there should 
be a system of^in-service training for teachers'. Teacher 
interns would be assigned to f>artlcularly effective teachers 

procedure would be as a prerequisite for licensing simii;r to 
the system used by the medical profession. ^ - 

Sone Specific Areas of CoDcer<y^Were; 

1. Hd; should the study be sequenced so that knowledge gained 
in the preliminary stages could be most effectively used? 

t^\:rr^X°' "^^'''^^'^^ 

3^ What observational instruments can best measure teacher 

diagnostic skills and communication abilities since both were 
considered important to the study? -crc . 

J^^fn^ under what conditions should information be gathered 
desJr^J probability of securing the goal^ 

In response to the original proposal and the specific arean of concern / 
by the members of the teacher performance phase, eight basic observations 
were made. - . 

0 

^Irf.r^^^ Intents^ the proposed study was to isJolate and 
ihlf ^n?o'^^^'^^*^^•^ behaviors. Since it wa/believed that 
l^lL . more, likely to be found by observing experienced 

rather than inesperienced teachers, initial emphasis sh^l?S pj^^ 
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on observing the experienced teachers. 

r ■ ' , . \ ' ' ■ ' '. / ' . 

2. Environmental and other factors affecting student ac^i'leveaent in 
- low incoae areas may be unlqu^ different than those in other 

areas. Therefore, research ^ould attempt to compare and contrast 
•. student achievement data in 16w incotee schools with schools in 
^ other aureas; ■ 

3. ^rbid based data should b* collected on all factors related to 

teacher behavior. Therefore,- there should be a red^^ tJon In the " 
the number of teachers to be observed, as propo^ In the riglnal 
' design, and, an ejktension oh the amount of observaticru, arid or ^ 
experimental data collected on each. 

k. .,'In-the Interest of reducing redundaincy and discovering the best 
available meAns of isolating possible conponents which may be 
- - observable in teacher behavior, an examination correlation and 

synthesis of appropriate >Uterature should be conducted early in 
the design. 

<* 

5. Although a compilation of significant factors which predictably 
lead to student achievement in reading nay be the desired object- 
ive*, it was recoB«aend«sd that initially a broader array 'of teacher 
toiaviors be exa«lne|^^ Xore than one and not more than three 
Weas should be stip#. Three possible ireas foV examination are- 
reading, mathematics /jiiS^ communication arts. 

■ ■ ■/ '^ '^^^^ ' < ' 

6. Districts selectiia fdt-' this desiga should be drawn from a random 
sampling of those districts which Vovlde for a reasonable chance- 

• ■'■ of success. Some attempt should be made to colilfy those districts 
where jJosltive teacher behaviors seem to be present; Random samp- 
ling frc« this group would then be conducted to gather' data. 

7. To Insure accuracy and to provide for possible re-exanlnatlon of 
data, video and audio tapes should be iislsd. '. 

8. One focus of the study should be" to attempt to identify precisely 
^ those coiiiponentB of coomiunlcation skills, if any, which affect 

positively teacher behavior and student achievements. 

It was the Judgment of the members of the teacher performance phase 
that the original design has merit. To maximize the effectiveness and to 
minimize the variables in the design, a concurrent proposal was offered to 
phase it in. 

ra^E I lieTRUCTIONAL AJJD ENVIROlWEirrAL VARIABLES AFFECTINO STUDEIfT 
ACHIBVaffiJfTS 



There should be a concentrated attempt to examine all possible 
vi^-iables affecting student achievement. Every conceivable system of analysis 
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. should be employed, including; an sanation, correlation andjjthesis of ' 
,; the Hyrrature in th>.| field, . experimental and, operational studies; systems 

for conecting data on the socio-econoBlc status of student? and^ t^oh|rf-B; 

administrators' attitudes Ind values; evaluation studies of mln^coutses; ' ' 

larger institutional training programs; and commonly acceprted principle -in ' 

educational texts. 

The initial study should be concentrated in -the tough areas where real'' 
problems, exist. Teams of evaluators equipped with video . and audio tapes 
should spend a significaht period ^f tin(e,in these regions. Attemptp, should 
be niade to isolate those instances where^sitive teacher behavlir and high 
•student achievement seem to be present. Studies should be conducted to de- 
termine the variables and causal conneo^ons t^ posltiveUtudent achievements. 
PHA5E II ' -TEACHER TRAINIJG 

The design for Phase II is contingent upon the outcome of Phase I. jj/ 
it^can be determined that certain environmental or teacher behavior componenis 
affect student achievements, then teach«§r training institutions woulct be 
encouraged, possibly through accredidation standards, to incorporate these 
findings into their training units. New teachers or retrained old teachers " 
would be observed to detennlne if they have developed the teacher l?ehivior 
characterist/cs desired^ ' ' 




^™ LI'PCEJ^ OF 'teacher BEHAVIORS TO STUDElfT ACHIBVBffiOT CRrPiRIOHS 
Measurement studies would >,be conducted to determine if newly acquired 
teacher behaviors a^ect student achievements. " / 

- SETTIlKi AND APPfjCATION OF LICEieiNG STANDARDS • • 

, Findings from the three phases would then be the basis for fashioning 
standards fot' licensing teachtrs. ' • 



Lnal Confer ence Hepdrt from PUPIL fRO CBiSS •'cOM^PT»r>K ' . .. 

. V ~ — ' — ' • . . ■ 

The group ^hich focusW upon the pupil progress phase of the propose* 



study concentrated its efforts u^n a critical" analysis^of the preliminary 
design and J:he idfentlfi cation of general pupil perl-- ce measurements , 
-which could .serve as a guide iii the develojment of more specific' ass essmeuo-, , 
InaterialsTi • 1 . 

SectlonV -^tudy/ Desif^n . / ' 

The pupil progress group has attempted to incoi^por ate .many of the ' 
suggestions which were proposed'by the other threi conference phase groups; 
we have,.howeveV, used as our frame of reference the Relationship of the - 
proposals to pupi/pi^ogreas as the basis for W following recommended design. 

The pupil progress ^oup believes that an undertaking of this size will 
require more than the twenty^^four months that was su^ested in the original 
■ proposal, we also believe that this project ' is a beginning for a continuoue 
evaluation system that wil|^projlde the Camlssidn with^ information upon' 
which the licensing proced.ui-es" can i-emaln dynamic. — ' 

We propose six phases ;to our design whlcK incorporate and expand the 
suggestions proposed by the other three conference phase groups. The pupi;L 
progress group has limited the dependent velriables in the design to reading 
performance, as many of the behaviors used in teaching reading^ do replicate 
t,heraselves in other, relationships with children. 

The terminology which identifies each of the six phases has been taken 
from the proposal" suggested' by conference phase group four which employs the 
following .terms; discrepancy analysis, casual analysis; identification of 
variable which most strongly affects reading performance, program iodlfilatio)i 
validation of program, and establishment" of licensing standards. 

We proppse that, in the dlacre|)ancy analysis phase that a thorough review 
of the literature be made, and that the instructional and environmental ' • i 
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It achievement be identified and categorized, 
'ied, a survey of available in&truments foi^ 
* these variables to student achievement should ' 
should- assess teacher behavior in relation to 
lessment procedure should include a pre and post 

n the study should include both new and experienced 
tion should contain ap age range of children" from 
udent populiation should also contain, a. large 
hildrejj^ but children from other income groups 
reserited. . ~ 

edures have been established and administrated, 
the design should begin. This phase should 
l<Jh win analyze as many relationship as possible, 
variables should place emphasis upon teacher 
(e-e*J?!'A, Basal Readers, Phonics, etc.). , 
:lude an analysis of the data dealing with 
ition of reading, and attitudes towards reading. : 
identify those teaching behaviors which most 
•aance.- This list of teaching behaviors should 
•aining institutions who will in turn establish, 
lese skills in their graduates. ' 
x:her training program will necessitate a one • 
tudy will be, a replication of the design, using 
ng the modlflTed teacher training program and a 
the second study will provide the Connlssion 
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with data for nak^^ recOBBendations axid modifications in teacher licensing 
standards* 

Section II Pupil Performance ABseaament » . , # 

The foUoirlng cGonents and reccwnendatlons are made concerning the 
measurment of piipil performance and progress as a part of the proposed 
study: ^ ' . 

' A. Importance: , . ^ 
, ^ However ccnqprehensive or elegant the design of a study of teachfer, 
coapetencies miay turn out to be the measures of pupil peformance 
which art chosen and used will be critiqal to the success of the 
study* These measures are seen, after all, as the criteria in 
terms of which the validity of various teacher competencies is to be 
assessed* ' They must therefore be convincing to all concerned as 
indicators what pupils have learned* 
B* Criterion-based Measures 

o . . 

It is our strong reccmnendation that the instruments earployed to 
assess pupil performance be criterion based, and not norm based* 
%t is to say, these measures ohould be inherently credible as 
rect indicators of i*at pupils are capable of doing as a result of 
instrubtion* For purposes of this study, there is no reason that 
scores on performance measxires be related to norms, whether national 
norms or local norms* In fact, there cfre probably good reAAons not to 
present the data in terns of noma, in order to avoid e—.-^-''!^ the 
possibility of school or district ccniparlsons* 

District Expectations ' ^ 

Once student performance objectives have been tentatively identified, 
district personnel should be given the opportunity of reviewing them. 



and of comenting upon any gross discrepancies that may appear 
between district expectations and study plans for these dimensions 
of student performance. ftLrticipating districts should, of course, 
^ agree that the objectives do represent their expectations; if not, 
they should decide not to particii>ate. To be sure^ districts may 
have additional objectives for pupil performance, and it should 
be understood that this fact will not interfere with the pro- 
secution^ Of the study. 

Suggested Pupil Performances y 

We suggest the foUoirlng dimensions of pxipil performance relevant 

to the area of reading activity; (l) Reading performance. 

(2) Positive attitude toward reading, and .(3) Application of 

reading. These are further sub-dlvlded and defined as follows: 

a. Reading perfonwuice should include the categories of reading 
cGuprehension and word decoding. 

CCBprehension is defined eis the child's ability to understand 
the meaning of expository axA fictional material, using words 
generally considered to be within his experience and in his 
- oral vocabulary* Comprehension includes the understanding of 
printed materials in other areas of the curriculum. 
Word decoding is defined as the ability to pronounce aloud 
printed words, familiar or unfamiliar. 

b. Positive attitude toward reading might be measured in a number 
of ways. The following are suggested as indicators: 

1. When given the opportunity to choose activities, the child 
voluntarily selects a book for reading (e.g., when entering ' 
class in the morning, after recess, during ••free time," etc.) 



2. Children spontaneously Join one another or fgjm into «iimn 
groups to re6ul to one another to share illustrations or to 
help one ainother vith vocabulary, / 

3. Children voluntarily share inforaation, or express feelings 
or ideas vith others about aaterial vhlch they have read, ' 

h. Children bring reading materials to share with others in 
class, 

5* Children choose reading as a vay of getting information 

(as opposed to listening cmd/or other aeans). 
Application or reading provides a measure of the generallzable 
use of reading skills. It is defined as the ability to us* the 
meaning of printed material to Mccnplish a variety of purpose- 
ful activities. Suggested possibilities for measurcaent are to 
determine irtiether the child can follow directions to assable 
a boy, successfully play a game after reading the rules, and use 
labels, captions and charts as he vorks in an activity. 
iThe assertion is made that data on Jlppllcation and Attitude 
may be more adequately collected by means other than paper 
and pencil instruments. While tradlonally we have been' prl;^*— - 
marily concerned with reading ccBprehension performance, we 
need to give at least equal aphasis to the development of 
positive attitudes and the ability to apply reading ccnrpetence 
In practical ways. 




Final Conference Report froa SCHOOL DISTOICT KXPBCTATIOJE OF PUPIL 

PgtFCRHiUCE ASSSSSMEm' CCMKITTEE 

It was recognized at the outset that the prescribed fraae of reference 
for responding to the series of proposed critical Issues y^oM require a 
disciplined effort to^de-eaphaslze but not exclude other points pf view. 

This group was of the opinion that the study should focus primarily 
on the chlldrei^ of the poor. Prlaarlly does not mean exclusively nor does 
It prescribe a fixed quantitative aaount. It recognized that children may only 
be seen In a spectrum of other children. This requires then, a reasonable 
Inclusion of other than poor children^ both for perspective and comparison. 
Without this, cause effect relatlonshlps-irtilch discriminate between teacher 
behaviors restating in perfornance of various, pupil typologies are unlikely 
to be dcBonstrated. 

^lKe socio-econcBilc status will be a major consideratioij, attention 
must also be devoted to bilingual, multilingual, and cross-cultural con- 
Bidejf^tjLona. .The father's occupation" and mother's educational level were 
considered to be significant. If these factors are to be considered realis- 
tically, the study must focus on the "the child" and the source of data 
must include data secured in the home rather than arbitrary assigment to 
a statistically e8t6a)llshed group. 

In this way data abait functional language, income and education, 
cultural identity and affiliation, extra and pre-school a<*vantages should 
be secured. / p ' 

Measurement of pupil performance for the purpose of establishing re-^ 
(julred teacher ccmpetencles should preferentially rely on criterion reference 
measures. This reccMiendatlon should not limit operation df the study ^ 
implmentor or the right of the CommisBloh to report to the jmblic. 
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The material by Tyler, Ryana, Coleaian, and Jenks are believed to be 
valued resources. , * 

The aeasurc&ent InstruMent 9electlqc\ procedure should Include partlclpatlan 
by relevant representatives of the local xinlt. 

The group strongly urges matching or equating for cla^s slxe, human, 
physical, and Instructional resources and ojrgani rational pattlJrns taA reg- 
ulations • . f 

/; , Tkit methods atnd* samples used must be strongly supportive of the 
cre<^entlal criteria requlreaent sotting responsibility of the CCMilsslon. 

Teachers should exhibit the skills required to cowinicAte effectively 
with children and ccwmity members. These skills must Include: those 
required to est^lish the teacher as a model ccmminicator In standard English, 
diagnostician, and prescrlber, and appliciator of required learning experiences. 

k teacher's academic^ background of one kins vas not considered to be 
more valuable than those ocf another's, but^ liking the elaients: to be taught 
both as a child and adult is considered significant. Acadenic background 
in r medial reading and arMs of general support of remedial reading Is 

considered to be advantageous. 

> 

The school district expects teachers to i>08se88 experiences and be- 
havlors vhich enhance eiq^thy toiraard, understanding of, and ccwinication vith 
parents and other members of the ccmminity vho represent the spectrtm of 
adults among irtiom the pupils exist. 

It is also expected that the teacher preparation institution will 
provide personnel trained to a degree of successfta practlve of J;hose be- 
haviors requisite to the production of desired pupil performance. 

The district vill only accept documented observation of the required / ^ ^ 
teacher behaviors. Evidence of completion of courses no longer has credibility; . 



c 

It is recamended that these behaviors be documented on the basis of 
observations, and of tf^lMng experiences in programs which cover a period 
of five years of teacher preparation. These programs should produce confident, 
coBpetetent, caring teachers prepared for the successful practive of the 
teaching profession. 

, CcB?>etence is considered to include those behaviors consistent with 
successful pupil performance in the beginning stages of reading, and 
developmental reading. Possession of technical behaviors in ronedial 
^learning, listening skills, and managoaent of learning environments was 
considered to be essential to the production of desured pupil performance. 
To these ends, data should be collected which describes the degree of teacher 
oapathy, knowledge of word attack aklUs, techniques of diagnosis and " 
prescription, functional levels of cognitive activity and interpersonal 
skills. The teacher preparation institutions should adequately screen and 
counsel and provide a background which will promote the continued maintenance 
of health and vigor ,of their teacher trainees. The teacher preparation 
institutions must provide the district with a documented list of additional 
required professional behaviors to be provided through in-service programs. 
It must be re-emphasized that documented observations of teacher behaviors 
must be field based. Screening and selection might include consiqlerations 
of the degree to which prospective teachers remember their own childhood 
experiences, their capacity for humor, and their persuasive ability. It iS 
considered essential that there be cooperative programs between the district 
and teacher preparation Institution which promote the acquisition of additional 
desirable teacher behaviors or the refinement of those possessed. 

The study of levels of school aupport of teacher behaviors should 
penetrate below the level of statistical assignment of dollar resources to 



the level of available products and sej^irlces. V 

The school district expects those behaviors in beginkng teachers 
which are basic to successful pupil perfonaance. The school district 
recognizes its responsibility to provide, in cooperation with the teacher 
training institutions, those experienced teacher behaviors which may be 
missing and to refine those ih need, of further development. 
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Pinal Coiiference Report from TBUCHER roSBHRATION IICT 

It vas agreed by all participants that the Coninisslon had a responsibility 
to carry out, the mandates of the Ryan Act, and that the Beginning Teacher 
Evaluation Study should give It a place to start by defining what canpetencle^ 
teacher preparation institutions ought to use in preparing teachers tp 
eff^lvely Instruct elenentcfcry children in reading. 

Institutional representatives on this j^omnittee object to that portion 
of the study that called for identifying teacher preparation institutions' 
expectations of thifelr students in advance on the basis that what institutions 
are currently doing _ltf this regard is Irrelevant to the study and could only 
lead to a list of discrepancies, proving little. The consensus agreement of 
the group was tljat "advance expectations'** should be eliminated frcm the 
study. ' ' ' * 

Having dispensed with the "advance expectations" portion W the study', 

participants attenqpted to re-Kleslgn the study, borrowing freedly tHe ideas 
f ■ • ■ . ■ ' 

and inputs gained from the' meetings held with other committees. The 

following is an abstract of the recommended steps presented on the ensuing . 

pa^es. The consultants frcm the teacher performance committee participated 

generously in a special session with representatives of this conmittee la 'the 

development of this document. 

Ab8tr6u:t 

1. Eliminate the part of the study calling for institutional 

' - ■ i 

expectancies. 

2. Select em "N** of new and experienced teachers. 

. 3» Collect, the* pupils, all pertinent SES, environmental, and 
perfomance data. 
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h. Analyze the causal factors existent In those classes where 

general high schlevement vas reported. Identifying In those classes 
^ the high SB achlerers, and the low SEB achievers. 

*i80 analyze the causal factors existent In those classes where 
general W achleveaent was reported. Identifying In those clasaes 
tiigh SES achievers, and the low SKS achievers. 

5. Sift out a list of causal factors that seem to be present In the 
• ^ behavior of the successful teachers, and report them to teacher 

preparatory Institutions. ' ^ ■ 

6. Expect those teacher preparation Institutions using the study's 
conpetencles to.establlsh an evaluatlon-feedback-correctlve process. 

7. Expect those teacher preparation Institutions not using the reported 
caapetencles, to establish a list f£ their Own, with rationale and 
also Include an evaluatlon-feedback-dorrectlve process. 

8. Apply the results of the study to the Commission's tvo major 
areas of concem~accreditation and licensing^. 

. iJrtroductlon 

This proposed comprehensive study of teaching ie an important 'under- 
taking. ,lts design draws upon the best resources, knowledge and, skills- 
available. But miracles fron It mist not be expected. It would be unrealistic 
to expect this study to provide a clear unequivocal factual base for a 
radically n«nf and different set of Uceaslng standards. Instant and slgnlf- 
leant results are unlikely. Ve can realistically expect some modest con- 
tribution toward establishing better standards than we now have. There. Is 
undeniably a widespread and strong dissatisfaction with ciirrent standards 

|pt licensing teachers, and there Is a rising auphasls to attempt to define 

. ft ■ ' 

S8u<* standards In behavioral terms— while experlenc^ to date suggests that 
|)rQgTes8 tovard this worthwhile goal will be difficult and slow, we have V ; 
during the past made ecne progress* 0/^» O 
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It l8 important to continue the search so that we viU have sooiething 
more than tradition and special interest as a base for pur standards* 
The Concept of the Design 

This proposal describes a research and developBient strategy whlth 
may be expected to have tvo najor consequences: (l) the plan de^ribed 
hereywlll, provide information relevant to.be not necessarily definitive 
for establishing criteria for the Ucensing of teachers; (2) the plan will 
stimulate modification of and innovations in teacher training programs 
dlrecte^ to Improving teacher ccnpetence. 

This plan ccaibines a variety of research techniques and strategies. 
Its purpose is to identify those ccnpetencies 6f teachers uMch affect 
significant changes in students, especially in important areas of in- 
struction, and specifically, in help^ing students to learn to read. 
Step I — Discrepancy Analysis. Locating Schools and Teachers Dmon- .. 
strably Effective in Producing Student Learning. 

The first tasks is to identify schools vhlch are remarkably effective 
in influencing students' iearning irrespective of where their students ssrc 
irtien they enter a phase of iheir education. To idenfeffy these schools we 
propose the following procedures: Using the test data gathered regularly 
in California, perform a regression analysis in which scores at a later 
grade are regressed on scores at. an earlier grade. This analysis tan be 
portrayed in Figure 2. Schools which fall above the regression line 
(•olid line in Figure 2) are schools in which the mean^ar average per- 
formance^ of students in that school exceed the statistical expectations . 
for their performance In ccmparisqn tcJ other schools* "School A's students 
(sec Figure 2) schored on the- average the sane als School B's, students at the 
first testing* ^t the second testing, however. School A's students were 



performing significantly better than School B/s. students. School A should 
be studied to determine vhat it is doing to influence student learning. 

The analysis performed at this step identifies such schools. We also 
reconmend that school ^stricts involved in this study ncmlnate schools 
irtil<:h they think are affecting student learning significantly. / 

The schools nominated together with the school^ identified in. the 
regression ana^sis are selected to identify teachers within them whose student 
are achieving significantly. • These teachers are identified by the 'statistical 
and nonination procedures described above. 



\ 



Step 2 — Identifying Factors Affecting Student Performance. 

(2) In the second step, several procedures are used to identify ; 
favors influencing student perform^ce. First, a statistical analysis 
is pterformed to particLL out and^to study the interactions among those 
factors other tl^an teacher performance which may be influencing student 
achievements . 

. Two Uneg^ of investigation are proposed to identify these factors. 
Befoiie either of these procedures is used, however, it is necessary to 
conceptuaUze those teacher behaviors likely, as inferr^ from, previous 
research and experience, to influence student learhing. . We reconmend 
that a task force be created'to develop this conceptualization. 

This conceptualization is then used to analyze: Lthose ccmponents of 
teaching skill which diYferentiate more effective teachers from those who 
kre achi^ng expected or "average" results. A sefcdnd statistical analysis, 
is made to determine what other factors, such as those associated with the 
hone and- conmunlty of the students, the. characteristics of classes, and 
staff, the organizational cUmate of the school and its pro-ams, 
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ciirrlculum, -materials, and facllltlefl affect student perfojmfmce and Intwact 

■ / . 

Tfith teacher performance* 

(b) At the same time, tjtiis conceptualization Is used as the basis 
of experimental studies in \)4ilch teachers are trained on" skills hyj>o- 
thesized to be inflviential on learning tof- read. These studies have two 
purposes: (l) to study how to train teachers to enewt the skills and 

°(^2)' to; study the effects of the use of the skills on "students' learning ' - ' 

4' ' ' ■ , r'.'. ■■;,*• 

to reado , . - '\ i'-:'-' 



,When t,«icherfl have b^n identified ^ teachii^^WiUs identified '.; 
that are likely icMmve an effect on ciiinilren's learning tb read, case . 
studies In^ depth should be jaade of the most effective teachers and of 
schools lAere children anp learning to read. The studies will also pro- 
vice additicbai^^iiforBiation on the factors ip the school and .comnuhlty vteLch 




fltake for effective learning and teaching, ^ 
Step 3 ~ Program Modification 

The results of the statistical analysis and the experimental and * 
-^gggg^g^^ ^es is a list of' competencies which Mere delived from an a^lysis. 
of the teachingOT^'^teaghw^^ose students wer? learning to read well and 
froa experimental studies of specific teaching skills. The list of these 
conpetenciea and infoijmation about ways to help teachcJrs acquire these' 
skills is sent to the colleges and universities. * 

The colleges and uniiS^er sit ies must thea provide ipvidence that their ' 
students are acquiring these idylls or evidence that they are Modifying 
their programs so they yUJ. acquire these skills. 
Step 4 ~ Field Evaluation — A foUow^-xxp of beginiirtig. teachers. 
The students yibo have demonstrated before beginning to teach that they 
have the requisite skills are then followed ihto the classrooms to study 
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teaching on chlldr^n^s reading skills. At this point 
s Is repeated. / X 

lie study Is leld ^wAj^datlon of the utility of 
irtilch^have been acqjilte^^ It provides add^lonal 
d.lls necessary to ^tmch reading. 
yr Licensing and Acer edltajblon/i^r oval. 

ie-lved from these sources, the list of com-^ 

o<:uch reading Is gradually refined. At the ttme that the 
lOugh to Indicate that these teaching performances are 

conditions they are^crltlcal, euid hov they are In- 
Ln the school and conmunlty, they can be the basis for 

ccwpetence. Further these experimental studies 
ilA followwxip vlll provide Information to develop 

stcmdards. ^ 
ICS OF THE RE3EARCH DB3IGN 

0 

s not spelled out *hrre. What follows It suggestive 
win proceed. 

'•sis 

n this model Is largely what Is proposed In the 

f first step Is an analysis (regression) \rtilch 

hose students are achieving well in reading and those 

of their initial reading performance. This type of 

in Figure 3 yhere the m?an scores for four teachers* 
own. V ^ . 

Teachers A and B and of Teachers C and D began on the 
oint in the fall. But students of Teachers A and D 
erage above what would be expected by spring. A full 

teachers represented, would identify all of those 



teachers whose students are performing better and^less veil than expected 
("expected" is a statistical concept: this regresaion analysis is 
postd lction). 

The teachers identified in this vay are compared. In essence, ve ask 
vhat is Teacher A doing- that makes him or her more effective. 
Causal An^dysis ^ ^ 

The second step (refer to Figure l) is a causal analysis of those 
factors ¥b±ch discriminate teachers vho fall above the line from those vho 
fall below. At this point ^Lt is necessary to determine what factors other 
than the teachers' ccnipetence may be accounting for the differences in 
stxident achievement. Such factors as those associated with home and 
conmunlty, cOBg>osition of classes, cha£rtu:t eristics of the staff and 
school, and of programs and facilities must be relat^ed to these differences. 
When the influence of these factors is partialled out, a group pf classes 
(teachers' with classes) is identified where the differences in student 
achleveaent may be reasonably attributed to differences in teachers' skills o 

These teachers. are then studied to identify those skills irtilch dis- 
tinguish the more successful from the less successful teachers. How this 
analysis may proceed is described in the foUoirtng section. The result of 
the analysis at this p^tr/is a list of canpetencies. 

Since one of l^e most important features of this design is the 
identification of teaching competencies that are associated with student 
performance, we describe in detail how this analysis might be made. We 
make no brief for all the details since many of these are negotiable. We 
wish to ccttmunlcate the possibilities that this kind of analysis has, and 
its style. 
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Figure k 

A Model of the Analysis to be m^e to Find Differences in Teaching Skill 
Associated vith Differences in Pupil Achievement 
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The steps In conducting" an analysis of differences In teaching 
ccupetence are: (See Figure 

Select tvo samples: (l) Experienced teachers and (2) Beginning 
^ teachers. 

Experienced teachers are Included to identify those conpetencies 
they possess which effect achleveaent. Those experienced teachers 
can then be coapared with beginning teachers to determine if there 
is a d^^f ftrencc:' in coB^etencies between Experienced and Beginning 
teacher*.. 7 ' , 

In additiOH; new teachers must be included in the study because: 
(1) the study originally focused on beginning teachers (this 16 
one of the conrtraints), (2) beginning teachers aay lack those 
ca^etencl«s which produce achievement, and (3) teacher training 
institutions may c 

possess t|^08^';cq?p^?^ which effect achiev^ent of children " 

iAen> :ln: fA^ty not preparing such teachers — a com- 

pari son of experienced and beginning teachers would determine 
this. 

2. The dependent variable is achlevment in reading. Achievement in 
reading can be detennined from standardized tests which measure 
comprehension (including decoding skills and vocabulary develop- 
ment). In addition, pupils' Attitudes'. toward reading should be 
included as part of the dependent variable. 

Low 8EB chlLlren generality score pooriy''\on standardized tests. 
Thus, many educators object to using standardized tests to assess 
low SEB children. However, the objective of the school J a to 
teach low BEB <:hlldren. Standardized tests will determine how well 
they have acquired reading ability as ccnrpared to the, general 
^ pupil population. In addition, teachers are attempting to teach 



children a reading curriculum that is geared to the general 



of the general population, ^hus, staridardized tests are reconmended 
ae the Instrument to measure the dependent variable; 
Experienced and Beginning teachers will be compared on the follow- 
ing independent variables. Rote that eight groups of teachers will 
be examined (see the diagram of the specific design). 
Teacher Personality Veu-iables 



population, stated another way, the teachers are attempting to 
"acculturate" low SEs' children to the reading habits and .^kllli 



8 




;v Attitude toward themselves 



Attitude toward children 



etc. 



Teacher Classroom Behavior Variables 



Competencies determined through an examination 



of the literature and an examination of teacher 
behavior in the claasroom 



Curriculum Vcuriables 



structure 



amount of time spent teaching reading/ • ■ 



materials 



aides! 

I, _ ■ • 



etc. 



Institutional Variables :^ 
Size of school 
^ '^ Interawrtion of faculty 

In-service tred-ning program ' Z 
etc. 

Curriculum and Institutional variables should be separated from teacher 
personality and teacher classrocm behavior variables. This would identify 
those teachers who possess the competencies of successful teacher, but who 
are not effecting achievement because'of curriculum and institutional 
contrednts. :^ 

FinaUy, £hi?;irt^ of independent variables is infinite. A problem 
of the study ^t^.t))^ determine which variables to include. Therefore, a 
thorough review of the literature must be conducted. Also, a pilot study 
,is strongly reconmended. 

THE BCPBRXMEWTAL PHASE ^ *^ 
The purposes of the experimental phase aire: 

1. To obtain cause-effect evidence on teacher behavior variables that 
have shown pronlse in correlational and causal-cAmparative resea?lh'. 

2. To explore the effects of teacher behaviors that are not likely 

t ■ ^ 

occur naturaUy in the behavioral repertoire of teai^e^ who^'H 
not received training that focuses upon these behavior^,^' 
behaviors would not show up in the initial phases of the ' research 
and would be overlooked if the experimental pliase wete not included. 
Procedures ' , 

These studies would typically employ pre-post control group eicperimental 
designs in which the independent variables would be specific teacher behavior 
patterns or strategies and the dependent variables would be pupil performano,© 
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measures. Although carried out in the field, these, studies would employ 
reasonably tight controls and would be carried out with small teacher samples. 

Experimental treatments would involve teacher "training using for the 
most part instructional modules that are already -available. ' Tested modules 
such as those that have been developed in the protocol materials projects, 
and at the regional laboratories and R. i D. Centers would be used. 
^ It seems likely that a series of such studies would be needed to 
achieve the purposes of this phase. These studies, however, would be 
carried out simultaneously. Thus, this phase could be completed in a 
relatively short time and at modest cost. 

CASE STUDY - -(individu^ Subject Design Phase) ' 
The purposes of this phase are: ' 
1^ To gain insights into variables operatting in the district, the 
school and the individual classroom that may have an effect upon 
learfter performance. It seems likely that many variables that 
would not show up in the other phases might be found because of 
the depth possible 'in the case study approawih. ^ ' 

2. To epqplore inter-pupil performance differences within a given 
classroon in order to identify possible, reasons why pupiJ.s of ' 
Similar capacity respond diffj^pnt^jr to' the b«^^ 
what, on- the siq-fac*-, .wtmld;:4 slmlW .ciaasrpcMi 

enviroi^nent. _Such e^Oii^ftt^^^^ provide evidence jabout ':the 

inner struct^ire the eiisl^dfito^^^^ will make a substantial 
contribution to the overall project. 
Procedures - 

The approach would involve a few -experienced and perceptive inves- 
tigators who would devote large blocks ,of time to looking in depth at the 



overall educatiotial environment." 

In order that this phase might provide evidence in addition to insights 
we. propose that each investigator identify pairs of children in a given 
classroom for official observation^' Eafch^'pair would include a child who is ' 
achieving well and a child of ccnparable ability and past performance who is 
aehievii^ poorly. Single; subject reseiarch design (such as employed in ex- 
perimental psychology and described in Sidman's book. Tactics of Scientific 
Research) would be employed to ccsnpare these children. Investigators would 
select several ^ai^r^ of ''cMld^ would replicate. as needed to test the 

stability of tren^' or betevior^patterns that emerge. , 
CONCLUSION ^ -^V: J ;;/'>/v;' 



■'V.;";,: 



The model then has several attractive features.' First, it yields iiir' ' 
formation on teaching competencies which are associated with differences Vh"' 
^tudent achievement. Second, it gives the cc^lleges and universities infor- 
mation on the performance of their graduates-^ .Third, it holds ^e colleges 
and universities accountable for modifying or improving their programs that 
is realistic, practical and manageable. Fourth, it provides data contin- 
uously on the performance of graduates which may be used to develop criteria 
for identifying effective programs. Fifth, it continually tests hypotheses 
a^out teaching competence. Sixth, it yields information about other factors 
that influence student p^rfoiiiiance. ^ ' ■ ■ \ : . 
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Results pf Meeting of Callfcg^nli Education Organizatio n Representatives, 
♦ Copimisslonersj emd 6tctff ' ' [ ^ 

' The fonow£jQg/potnments and responses were received during the, general 

meeting of the GxMmlsslon representatives, contractors and institutions 'and 

education orgeuilzatlon representatives from California, ' ^, ' 

Dr. Charles Johnson, University of Georgia, College of Education/! 

relayed their experiences in Atlanta when an evaluation-of an Atlanta 

reading program was undertaken. He stated that it was his experience that 

there are problems wlth.r^ test results public. Also, the teache/s and 

^principals must knowI^exai'atiV how the)evaluation is being administered. 

Raoul Teichlet, Ciiifornla Federation of Teachers, feels that .-there 

will be total cooperation at the district level with the teachers as we 

research activity from evaluation and clearly identify the 

ttame of reference for the teachers that t'Key are part of something. If ^ ^; 

this project Is undertaken as an evaluation there may be less cooperation^ • ; 

J. Alden Vanderpool, of the California Teachers Association, ■'ccJinmended 

the Commission for the way in whJLch they obtaSrned the coiisehsus of an outside- 

group with regard to th^ir study 'design. He stated that he would be willing 

to recdriroend to CTA's State Council and Board of Governors- if need be that 

teachers coo^^ate. He stated that it will takfe a Very gi-eat effort to get 

the understanding ^nat will be nec:^B8ajr^ to^si^- a -pfoiect like this work. 
"' /■ ' *.' ■ " ■ ' . ' ■ ■ 

.^l^eguard must be' that the teachers cannot be^ "volunteered" to work on ^ 

..- ' ' , • . ■ ■ , • 

ect.tf>They must volunteer of their own accord wi^out having any 
% -pressure applied to them. Some release frap the teaching '^load 

g^-<feA" to. those who participate In' *his study, whether in the form 
°/ -W^^ relief from additional district responsibilities. 

pe some assurance that the contractor will' talk the project 
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over with the teach'^er aserbciations. at the appropriate Comnittee or other 

'■/•^ • ' • • • ■ \ 

levels so that understanding results, and no teacher 4<^o volunteers becomes' 

• r 

a target for any kind of outside pressure. Ee, eLLso feels it is necessary 

.. ' 

that <s(OTiedne "watchdog" over' the project. This should be someone who both the 
Ccnmission and the district trusts and shoulH^TO' outside the contracting 

agency. _ . - . v 

\ ' ■ ^ . . 

I Tom. Heddon, ACSA, Chairman, Committee of Professional Preparation and 

Credentials stated that the approach ,the toomlssion is taking shows great 

■ r ' ■i 

promise. He "would/ however, have to see the final design, before aiiy 
endorsement could be matie. If the safe-guards are there in terms 6f in- 
voivement of districts and associations, emd being assured thAt the project 
would be on a volutiteer basis, he feels that his association' would be willing' 
to cooperate in thl3 kind of program. : 

John Baird', California University emd^ Colleges, stated -that he feels 
that he can report ^tp^ the Chancellor and-*the Deems of fiducatl,on that they 
will hot have the problems that iiaHy have for'eseen and that the Commission 
and the conferees seem to be working toward ^ mutulal acceptable solution to 4^ 
what appears to be a rather difficiilt problem. / ' " 

Leo Cain; Boar'fl of Trustees, Callforniii: State UhlV^sities and Colleges 
^ feels that the. ^ty.dyv^wlli be endorsed but that it should be remembered that 
there is a certain amount of otopus autonomy emd the campus must understand 
the cooperation aspect. 

I^ouglae iMlnnls, C.C.E.T., stated that hp felt there woiUd be' two questions' 
raised by the California Council on the -Education of Tcflichers: (l) the 
relationship of the research to public policy. (2) wili'the universities 
and college campus cooperate in the study? In 1969, the research material 
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available in teacher education was studied. There i's now a pretty broad 
acceptance that teacher behavior is a source for teacher education. If the 
research design really offers some answers th^ will be ho diffieulty with 
cooperation. However, if it looks like a pro J eet that will get' little 
result, there may, not be much interest* * , ' 

Robert N. Bush, Stanford University Rebearth and Development Center 
stated t«at unless you can go out into, the schools' and get them to collab- 
orate in this effort',- there can be no success. He feels that the Commission 
will be able to bring .the groups together in this' effort as- collaborators. 
He feels that In the ^original design and the suggestions* made for modification 
there is not eiibugh^ built in/ continuous, syst^ematic feedback W that -it is 
important that more be built into the design, • - 

): > ' . ■ ' . ' \ ' ' ' 

Charles Johnson stated that another important consideration is- who 

' - ^1 ■ * , 

administers the measurement instruments in the classroom. He suggested that" 
even though it is terribly costly it may be necessar'y for* outsiders to ad- 
minister the instnoments. t 

The possibility release time or some other form of. relief from j 
teacher responsibilities Was discussed. , it was felt that this is extr^ely 

im^rtant but 'that df a design was presented that had a release time factor " 

. v . ' . • ■' ' '■ ■ .| 

built in, there would be, considerable objection. However,' if ^ome help in the 

administration' Of thfe testing and evaluation iilstruments vas provided, there 
would be no objection. - ' - 

Mrs. Paulette Johnson, an elementary" tfeacher 6n the Commission, .stated 
that -she wa?,. very ^enthusiastic about 'the'-^proj^ct and with the support of her 
principal would 'be inclined to volunteer for the project. However, she ' 
feels it important that the parents be informed as to what is happening .with 
regard to the study. 

"■9 . ' 



That the overall design shcmld identify the causal factors related 
to those Situations where high and low achievement occurs. * 
That the &tyidy should measure more than the student achievement in 
reading skills. Most felt that the higher cognitive areas should 
also be included. ' - 

TKat pre-tests, post-tests and delayed post-tests of studeiit 

recuiing should be conducted. 

^ - 

That pupil reading performances should be evaluated by the foll6w- • 
ing -factors; 

a. - Assessment of ccniprehension. ^ . o 

b. DeteiTnination of student's attitudes toward learnlJhg, 

c. The degree to which students 'ftpply reading. 

That some part of the study must be concerned with the ^tdaching 
of reading in bilingual, multi-lingual and cross -cultural situations. 
That in order to secure verifiable economic, information about parents 
the study will haVe to go directly to the home. • . 

That a statistical analysis shcjuld be conducted to determine'~what ' 
factors <3ther' than teacher behavior influence student achievement. • 
Factors associated with the hcqie, the community, the individual ' • 
p^sonality of a given class, the faculty and the organizational ^ 
climate bf a specific school need to be examln^. In addition,, feuch 
aspects as programmed curriculum materials and school facilities 
as they afffect and interact with teacher performance should be 
included in this study. 

That, once teachers and teacher skills have been i^dentified as 
having positive effects on student achievement, individual in- « 
depth case studies should be conducted. * . 



16,. That studies should' be conducted t9 measure if newly acquired 

teaching behavior affects student achievement. 

' . > . ■' • , ' • 

17. That gince teacher behavior and student, achievement ai-fe rdlkted 

. ■ ^ ■ ■ " ■ '■ 

to socio-economic, considerations, sffhool district exp^ectations 

and 'teacher preparation; these areas also need to be incorporated; 

;•. .' in this reseau-ch, desifitn. ' ■ ' ; ^ ^ ' ,-' . 

18. TJiat the study should focus on the children. o5f the poori 'w^^ ' ' 

including other socio-economic groups to . provide a sharp6r com- • * 
■ pari son. . : ' j ' - ■■ '1^ ^ 

. CCBREIATION. SUMMARY. AND SYWTHESIS OF CONFIR EHCR FTNnTWr.s 
- Detailed examination of the transcripts of this cgnference reveal^ - „ 
that there were twenty-seven ar?as of gefaeral agreement ^ four areas 
of disagreement. , 
A. Areas of General Agreement - 

1-. That th« study is needed: ; 

a. To cprrelate and synthesize existing studies in the -rea of 

teacher behavior and student achievement. ' 
. - 1 ■ " . ■ - 

b. ^ To provide information ih the area of competency based teacher 

evaluation, >' . ' • 

c. To cci^y with the memdate of the' Ryan Act> ' 

2.- That appropriate literature should be examined in order to determine' 
wh^t type of teacher behavior shtmld be investigated and what systems' 
should be used to evaluate student achievement. 
. 3.' That a teacher 's.di^rfostic /bili^les and communication skills should 

be included in the- study. Thus, a' systm of determlng and measuring ' 
the car ents in each ajsea should bi^ devised. .. ' 

k. That evaluation methods ' should include experimental, obstt-vatiOnal, . 

. and paper and pencil instruments. These instruments need to be de- ? 

'signed and/ or adapted in order to measure teacher behavior euid 
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aM student achievement. 

5. rm a system of identifying those teacher behaviors which most , . 
'"btrongly affected reading performance be constructed. 

6. Th^t data should be collected which describes the degree of empathy, 
cognitive activity, and skills in interperson^ ' -lations of the 
teachers involved in this study. 

7. That an effort should be made to identif. ..usal factors that 
are exhibited in the performance of successful teachers. 

8. That a need exists to determine the techniques used with lower - 
income groups which enable them to reach higher levels of .^achieve- 
ment. ^ • . 

19. That the portion of the study calling fof- identificatioh of teacher 
preparation institution's expectations for their candidates was im- 
portant to the study. 

20. That teacher training should be competency based and not based-' on how 
much one knows, about skills. 

21. That school districts should assist in developing the list of skills 
that applicants should, demorstrate upon entry into the profession. 

22. That teacher training institutions should be encouraged to^ develop 
programs of study which would incorporate the data collected- in this 
research. 

23. That the overall design should include validation sysfems, and provide 
use of computers, video and audio tapee. 

2k. That the^tudy should proceed in separate stages. Suggested stages were 

the gathering, correlating and synthesizing of information, the application 
and testing of informati^^he altering of teacher preparations and the 
adoption of these standards to the liceneing of teachers. All these^areas 
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were eonsidered vital to the overall design. ' ' . 
"B. Ayeas of Disagreement 

1. Whether the ttdd^y should compare e^erience with ^nexperi'ence 
and/or effective with ineffective teachintr. 

;• • . * . "■. . . ' 

2. . whether selected-districts or ^pd'ividual. sQh<5'61s and teachers 

%hcmld be used as targets for the Study. . 

3. wheth* the instrument^wnployed to assess pupil performance be' 
criterion based, or norm -based. Some advocated both, • 

. ^k,. two different procedures wer? 'suggested for s^ectidh of ^school 
districts and teachers^to^ be used in this study. 

One proposal was a random study of those districts which 
seem to have a propensity $oward high student achievement.' 
The proponents of this position contend 'that such.a system, 
would eliminate politics and/or embarrassment .to the par- 
/) ticipants in the -design. 

b. A second proposal was to establish. a system of comparative 
testing coupled with .the nomlnatlon.-of . schools and teachers 
by peer institutions.- The proponei?ts of ^his position con- 
tend, that this would provide greater accurac:y,n the de- 
termination of those schools and teachers which have the 
greatest effc^rt of student achievement. 
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Conference Findings Oh the Characteristics Necessary For Positive 
Teaching Behavior " ] [ ' y 

1. Teachers should exhibit the skills necess^Y to communicate effectively 
with other people. 

2. Teachers should be' model communicators of a stismdard American English. 

3- Teachers should enjoy the materleJ. being taught.' 

h. Evidence 9f completion of courses should not be the only means for 

establishing criteria for effective teaching. * 
■ *■ * V ' 

5. -The teacher should be a ^varnr. iifl caring human being. " 

6. , The teacher should possess the Skills necessary to handle the remedy 

learner. Stress should be put on the development of listening skills 
In a variety of learning environments. - 
7- The teacher should have a commeuid of word attack skills. 
8. The teacher should be a diagnostician of learning problems and be able 
■to p3f escribe solutions to- solve those problms. 
^9. The teacher should be able to identify and develop levels of both the 

student's cognitive and affective ^behavior. 
10. The teacher should be sldLlled'in human relations and be able to handle 

interpersonal conflicts. • . 

U. The teacher should be a diagnbsticieui^ prescriber and applicator of a 

creative learning experience. ' ^ '-y. 

,^^2. A teacher should be compatible with the IocglL c,ommuni'ty in which he or 
she teaches ai^d should understand the socio-economic conditions of the 
^ parents in the local school district in which he or she. teaches ^ 

local school and ccOTnunity should recognize that the support of 
the teacher is a primary factor in' the .teacher 's success. 
Ik. ' The teacher should demonstrate knowledge in the use of a variety of teaching 
, ^methods fn order to be able to deal with a wide range of classroom si'^' 
uatlons. , . g y 
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Conference Findings for Alternative Designs (Submitted By Phases I. II ana 



The teacher performaiicc Committee £triictured a four-step design. These ' 
four steps were (a) Instructional an\i environmental variables affecting stu- 
^> - . r^. achievement; (b) Teacher training; (d) The jinking of teacher behaviors 

to -student achievement ci-iterions; and (d/ The application and establishment 
, of teacher licensing stsuidards. 
^^^P ^' Instructional and Environmental Variables Affecting Student Achievement 

1. Examine literature and develop a list of individual factors re- 
^^^^ *° effective teacher behavior and student achievement. 

2. Discover districts in lower socio-economic areas where student' 
achievement is relatively high. Use a random system to de- 
termine which of these districts should be included in the 
study. 

3. Focus on the experienced effective teacher in the.se selected 
- ' districts. 

h. Create both observational instruments and experimental instru- 
ments to examine all factors affecting student achievement in 
low socio-economic areas. • . 

. 5. Establish a. task force of J observers equipped with audio and 

video equipnent, to observe for ''specif ic periods ©f time in * 
these. assigned districts in order to sift out positive per- 
fonnance factors. , ' 
6. Use every conceivable system to gather additional data including 
observational and experimental studies, evaluations stud:^.^ of 
mini-courses run by larger institutional training' programs, and 



- case studies of effective tekchers with positive behavior. 
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7. After completion of this. study In the lower socio-economic 

districts, a similar study would be conducted in other areas. ' 
Canparison and contrast of findings would then be conducted to 
determine if there are any significant differences between 
positive teacher behavior in the lower socio-economic districts 
and other areas. .Audio and video tapes Would be re-examined 
to assist in verifying these findings. 
.Step B: Teacher Tralninfi ' 

1. The design of Phase II would be contingent upon the outcome of 
Phase I. 

2. - Teacher tr^ning institutions would be encouraged, pos^i-bly.. 

through changes in state accreditation standards, to incoporate 
these findings into their training institutions. ' ' 

3. Experimental studies, mini -training workshops, case studies, and 
possible internship systems would be studied to determine the 
best approaches to training new teachers to develop these de- 
sired skills. ' " 

k. The retraining of experienced teachers would be observed to de- 
termine if they have developed the positive teacher characteristics 
desired. 

The Linking of Teacher Behav iors to Student Achievement C rltertnn. 

1. Measurement studies would be conducted to determine if newly 
aquired teacher behaviors affected student achieveme^. ' 

2. Post-student achievement records wai .e examined in order to 
observe if those students taught by inexperienced teachers in the ' 

' designated districts had improved. The findings of this study 

would be compared with student achievement records in the same ' 
or slmilAT districts. This would be done in order to see if 
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differences existed in those classes taugjit byo newly training 
teachers who possessed the desired behavioral characteristics, 
Step D; The Application and Establishment of Teacher Licensing Sta nde^-ds ^ 

1. If the results of the previous three phases warrant it, minimum 
standards for teacher licensing would be recommended. 

2. Measurement systems would be developed to determine if newly 
trained teacher candidates possess those minimum standards de-. 
sired. 

3. Licensing would be contingent upon a candidate's demonstrated 
abilities in the in the areas identified by these studies. 

Pupil Progress Degign 

The pupil progress coimnittee structured a design, with s,ix steps. The steps 
were:, (A) Discrepancy analysis, (b) Causal analysis; (c) Identification of 
variables strongly affecting reading performance; (d) Program modification; 
(E) Validation of programs; and (F) Establishment of licensing standards. 
Step A: Discrepancy Analysis 

1. A 1:horough review of the literature would be made. 

2. Instructional and environmental variables which affect student 
achievement would be identified and categorized. 

3. A survey of available instruments for assessing the relationship 
of these variables to student achievement would be pursued. 

h. Instriaments would be selected which would assess teacher be- 
havior in relationship to reading performance. 

5. Pre-test, post-test, and delayed post-test measurement of 
students would be undertaken.* 

6. Teacher population in the study would include both new and 
' experienced teachers. 

. : 60 • ^ 
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8. student population would include a large group segment of ; • 
low inccwe children. Children from other ' income groups would . 
also be euleqiiately represented. 
Step B: Causea Analysis . < ' ' 

1. A factorial design examining as many relationships as possible 

would be established. 
2'. Instructional analysis would place emphasis upon teacher be- ■ ; 

hkvior and reading approaches. ' ' 

3. ' Stx^dent performance would include an analysis of the data 

dealing with reading comprehension, application of reading, 

and attitudes towards reading. 
^- Identification Of Variable s Strongly Affecting Reading Perfonmince> 

1. The causal analysis would identify those teaching behaviors which 
most strongly affect reading performance.. 
Step D: Program Modification 

1. Teacher training institutions would be asked to establish 
programs that would develop theBe 49si red skills in their ^ 
graduates. /-F^'^^^'^^ -. V - - ■ V ' ' 



Step E: Validation Of Programs - >^ - . ; 

1. A one year field study would be necessary to validate these ' ' 
findings. 

2. This field study would be a replication of ^he design €pploylng 
recent teacher graduates completing the modified teacher train- 
ing programs and a control ^oup. 

Step F: Establishment Of Licensin^^ Standards 

•I ' • ' . ■ 

1. The results of the second study would provide the Commission with 
data for making reconmendations and modifications in teacher 
% licensing stajadards. 



Teac^ier Preparation Institutions Design 

A five step system was developed by the Teacher Preparation Institutions 
Committee. Steps weref (a) Discrepancy analysis; (b) Identifying factors 
affecting student performance; (c) Program modification; (d) Field Eval- 
uajtlon; and (e) Criteria of licensing and accreditation — approval. 
Step A: Discrepflincy Analysis • 

1. The first task would be to identify schools which are re- 
markably effective in influencing the learning of students 
irrespective of where the students were when they entered 
this phase of their education. ^• 

2. Perform a regression analysis of test' data gathered^ regularly 
in California. (See procedure in original design.) 

3. Those schools in which' student's perform signlf iceuitly better 

would be selected for this study. 

.' •' ; 

h. School districts evaluated in this study would nominate those 
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schools which they feel are af^^^ng student learning signi- 
ficantly. 

5. Ncminated schools and identified schools would be selected to 
identify those teachers ^ose students are achieving signi- 
/ v ; flcantly better. 

.Stejp.B: Identifying Factors Affecting Student Performance 

,1. -A.s^tjLstlcal auialysls would be performed to identify and to 
'. . study the' interactions among those factors other than teacher 

. . . V'performance which may be influencing sti^t^t-achieveijient. 
^ 2. A .Ta^ Force would be developed to conceptualize the teacher 
behavior likely to influenoe student-achievement by examining 
0 previous reseeurch and experience. 
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. 3. This conceptualization would then/be used to analyze the 

components of teaching skills which differentiate the more ' •" 

^fective .teachers from. those^achera achieving -"average" 

■> 

results. 

k. A statistical analysis youJ.d be made to determine if. other 
factors affect student performance and interact with teacher 
performance. ' ^ 

5. This conceptualization would be used as the basis for experimental 
studies in which teachers are trained in developing the skills 
found to be influential in a pupil's learning to read. 

6. In-depth case studies would be.nlade of those schools and tkose 
• effective teachers Whose children are:iiearnlng to read. 

Step C: Program Modification ( ' - r - 

; ^' ^ list identifying the competencies of the more effective 
teachers would be develope^rr""^ 

2. This informational list of competency skills, along with \ 
suggestions to help teachers acquire' those skills would be 

sent to colleges and universities which train teachers. 

3. -Those colleges and universities may then be asked to" provide 

evidence that their students are workl^ng to acquire these skills. 

, • ^ <i^*e, those teacher training institutions will be 

aske^l ^ present evidence that they are modifying their programs , 
to irtSufe that future teachers acquire t^hese skills. 

Step D:° Field Evaluation 

^ 1. The students who have demonstrated before beginning to teach 
.; that they have*the requisite skill, could be followed into the 

^ classroom to study the effects of teaching on these- children's 
reading skills. At this point the cycle of analysis would be 
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^repeated, ' 

Criteria 'For Ucenslng And Acg- 

*• * ■ • . 

1. The list of competencies- 




itlon — Approval . 
gradually refined. 



2.. Whenever new evideiRe ind^t^.t^^ skiliB a^^i 



critical, 'these vould^be^st^ founcl significant, t^g 
nev ccWetiencies will l^Jhe ,^^i|^or future licensing and 
teachers accredatiogj* ^; 
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APPENDIX A -- Section 131irof Teacher Preparation and Ucensing ■ 
, Law of 1970. .* . * * . . 

ISllJ^ - The duties of the commission 8hall>be 1 9.. implement this chapter, ^ 
.'to establish and promulgate stanjj^s and procedures for cert^Lfprlng ed- ' % 
ucational personne; as qu^llified for a license to practice in the public ' 
scfcools of -Calif orMa, and -to -support, facilitat,e, and dilineaTte functions 
and programs Of preparation for the teaching. profession. j 

^ , The Commlersion, consistent with the terms and provisions of this ' 
article, shall have the following powers and duties': 

(a) To develop 8t€Lndards and procedures for the certification 
of educational personnel. ^ j 

(b^ To promulgate appropriate rules and regulations. 

(c) To issue credentials upon certification to the State 
Board of Education. ^ 

(d) To provide leadership a^"to coordinate resource? for the 
improvement of teacher education. 

(e) To establish advisory committees consisting or representatives 
from various elements o^ the teaching profession related to each subject ' 
specialization which will help formulate perfonnance standards for general 
teaching and other educational specieaties. 

(f ) To develop and recommend to the Leglslatture for Its approval 
alternative ways in which to demonstrate qiialif ications^ for licensing which 
are adapted to individual differences in candidates, preparing institutions, 
and performance requirements, while at the same time protecting against 
incompetence. / 

(g) To develop Objective, independently verifiable standards of 
measuraient and evaluation of teaching colnpetence as it relates, to teacher ' ' 
licensing. 
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(h) To develop new or employ' existing objective, examin&itlons 
as a measure of subject matter knowledge for the purpose of ceftif3d.ng ed- 
ucational' personnel. V 

' . - ' ' • " ■ 

(i) To develop objective standards for the identification of 
speciedtst teachers. ' - ' ; .,' ' ■ 

^ ; ' ' To monitor .and evaluate' the results of its aqtiojn- as it 

relates to the performance of teachers licensed under thi§ ^ticle.'". ' , 
, — (k) . To develop and recoonnend to the Legislatut* for. its con-' 
sideration, any necessary or desirable legislation to require the continuing 
education of certified personnelxand the issuance of life credentials. 
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Article 5.5 Evaluation and Assessment of < 

Performance of Certificated Snplbyees * • 

13i^5. It is the iAtent pf the Legislature to establish a uniform systfflf 

of evaluation and assessment of $he performance , of de^tificated personnel ' 

within each school district of the state. The system" shall Involve the 

development and adoption by each school district of objective evaluation 

euid assessment guidelines. 

13i^6. In^the develc?pment .and adoption of these guidelines and procedures, 
rtihe governingc^board shall avail itself of .tttb advice of^ the certificated^ . 
instructional. personnel in the district's organization of certificated, 

personnel., » , ^ 

. ■ ■ - ' ^.-^ " , ' . 

131+87.' The governing board of each school district shall develop and 
adopt specific evaluation and assessment guidelines which shall include 
but shall not necessarily be limited' in content to the following elements: 

• • Ca^ ^ "l^e: establishment of standards of expected- student ^p^^ 
in each area of ptudy and of t^chni^ues for the aatiessment of 'that progress. 

.» . (b) Assessment of certificate personnel competence as it relates 
to thevestabli shed standards. ' ^ • ' ^ 

(c) Assessment of ot^er dul^ies normally required t'o be per- 
fpfmed by certificated enq^loye^^ as aq/adj.unct to thei^ regjilar assignments. 

■ ' h ^.^h establi^B^ot of^.;^ocedures alnd techniques for as- 

cer^adnin^th^ the cei^f ieatell^^^ is maintaining proper control and 

l8 preswvirig^a' suitabre^^l^i^'envirora^ 

rs^l*^. .E^^ assessment made pursuant to this article shall be 

i;4iUced: to/wrlting aAd a^opy thereor ^hall be ttansmlttk to .the certificated 
eiig)loyee'jiot"iit^r ^han .60 cfeys before the end- of^ eacK school year -in which 



Appendix B: (continued) 

the evaluation tak^s place. The certificated employee shall have the .right 
to initiate a written reaction or response to the -evaluation. Such response 
shall become a permanent attachment to the en^loyee's personnel file. Before 
the end of the school year, ^ a meeting shall be held between the certificated 
personnel and the evaluator to discuss the evaluation. 

13^^89. . Bv^uation and assessment of the performance of -each certificated 
employee shall be made on a continuing basis, at least once -each school 
yrfar for probationary persomiel, and at least every other year foi^ personnel 
with permanent status. The evaluation shall include, recommendations, if 
necessary, as to areas of improvement in the performance of the employee. 
In the event an employee is not performing his duties in a satisfactory 
manner according to the standards prescribed by the governing board,. the 
employing authority shall notify the employee in writing of such fact and 
describe such unsatisfactory performance. The employing authority shal,l. 
thereafter corner with the employee making specific recLmendations as to 
areas of improvement in the employee's performattpe and endeavor to. assist 
him in such performance, / f ' -^^ . 

Sec. 111. Sections 1 to 39 of this act s^all becom^^ operative on 
the 6l8t day after the final ad;journment of the 1972 Regular Session of 
thi Legislature. 

Sec. If2. Article 5\commencing with Section I3UOI) and Article 5.5' 
(commencing vith Section 13^*85) of Chapter 2 of Division 10 of the- Education 
Code shall not apply to certificated employees in community colleges if 
Senate Bill No. 696 or Assembly Bill No. 3032 is enacted at the I97I R|pular 
Session of ^the Legislature. ' 

■ ^ , -i ■ 

NOTE: , , 

Article 5.5 became Effective Septembe|r 1, 1972. 

Sections 1 thr^ough 39 will become effective on the 6lst day after adjourn- 
ment of the "veto session" of the I972 Legislature. 

\ : ■ ^ ■ ■ . ' 
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Baird, Joh^i< Chemcellor's Office ' \ ^ . - ' 

* ' 

Borg, Walter: Utah State University ^' ^ ^ - ^ 

Boyd, WllUam: ■-Bureau of Teacher Education, ,New York^ State Eduction Department 

B5.aun, Frederick: University of Hskwali '. „ 

Bush/ Robert*: Stanford Research and Development CeJffeer 

'Campbell/ Vince: American Institute for Research, Stanford 

Collins, Carter: Office of Economic Opportunity 

Cronbach, Lee: Stanford University . . ^ 

Cross/^ James G. M.D., C.S.B.A/ 

Delevan, Fretnk: Department pT Finemce ' > 

Finley, Carmen: American Institute for Research 

Fisher, William: V Superintendent of Schools, . Orinda Union Elementary, 

. Orinda, California ' . 

Foster, Marcus: Superintendent, Oakland C^tyJJnlfied, Schools. ^f. 

Gagne, Robert M: Center-Behavioral Sciences, Stanford ^ 

Gatheral, Maryann: Representing University of California (teaching at Davis) 

Goodland, John: Dean, Graduate School of Education U.C.L.A. 

y . ' . - ' • ■ ■ ■ 

Gordon, Garford: C.T.A. - , , / 

Redden, Thomas: . Association California Schopl Administrators 

Hunt, Herold C: Professor Eneritus, Harvard > . ' . 

Johnson, Charles: University of Georgia " *- 

Johnson, Ken: Prdfessor of Education, Berkeley 

Levin, Henry: Stemford' University 

Llndgren, Richard: Nat. Ed. Prog. Association \ ' 

McDonald, Pi-"e^: Director, Division of Education Studies, ETS. - . 

Chairman, Teacher Education Research, School Divisj^on ■ 
Marderosl«n, Haig: Professor, University of Massachusetts 
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' Education, Head of Teacher Education, U.C. Davis 

Newcomer, Lee: President, La Verne -College 

Rosenshine, BaraS: University of Illinois 

Silvaroll, Nick:. Arizona State University (Teinpe) 

Sorenaon, Philip: Stanford Research Institute 

Stallings, Jane: Stanford Rese^ch Insitute 

Teilhet, Raoul: Califtornia Federation of Teachei-s 

Vanderpool, J. Alden: California Teachers Association 

Vasquez, James: Contemporary Research, Inc. 
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